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SUMMARY 

This  paper  presents  an  analysis  of  Energy  Conservation 
Measures  (ECMs)  performGd  between  1981  and  1985  on  24  gas-heated 
Montana  schools.   This  analysis  was  performed  to  evaluate  how 
effective  ECMs  are  in  reducing  space  heating  energy  consumption, 
and  to  compare  the  estimated  cost  and  savings  used  to  qualify 
schools  for  ECM  funding  with  the  actual  costs  and  savings  that 
result  from  implementing  the  ECMs. 

The  ECMs  considered  in  this  analysis  were  partially  funded 
through  the  Institutional  Conservation  Program  (TCP).   The  ICP  is 
a  federally  funded  program  that  provides  fifty  percent  matching 
grants  for  conservation  activities  in  schools  and  hospitals.   In 
Montana,  the  ICP  is  administered  by  the  Department  of  Natural 
Resources  and  Conservation  (DNRC) . 

The  results  of  DNRC ' s  analysis  show  that  ECMs  are  effective 
in  reducing  space  heating  gas  consumption  at  most  schools,  and 
are  cost-effective.   For  the  24  schools  considered  in  this 
analysis,  the  mean  annual  reduction  in  natural  gas  consumption  is 
20  percent,  or  1,200  mcf  per  year  for  each  school.   The  mean  cost 
of  the  ECMs  is  $36,700,  or  $0.82  per  square  foot  of  floor  area. 
Assuming  a  20  year  life  for  the  ECMs,  a  4.6  percent  real  discount 
rate,  and  a  natural  gas  cost  of  $4.50/mcf,  the  mean  net  present 
value  of  the  ECMs  is  $34,600  per  school.   The  combined  net 
economic  benefit  realized  by  the  group  of  schools  is  $829,700. 
This  means  that  the  savings  from  reduced  heating  costs  more  than 
pays  for  the  ECM's. 

This  analysis  also  shows  that  ECM  costs  were  slightly 
underestimated  in  ICP  grant  applications.   However,  the 
difference  between  estimated  costs  and  the  actual  costs  paid  to 
contractors  for  performing  the  ECMs  are  not  statistically 
significant.   The  mean  estimated  cost  of  the  ECMs  is  $31,000, 
which  is  $6,000  dollars  less  than  the  actual  cost.   Additionally, 
the  natural  gas  savings  were  overestimated  in  grant  applications 
by  an  average  of  300  mcf  per  year,  but  the  difference  is  not 
significant.   The  mean  estimated  decrease  in  natural  gas  use  is 
1,600  mcf  per  year  while  DNRC ' s  analysis  shows  the  savings  are 
1,200  mcf  per  year. 


INTRODUCTION 


The  Institutional  Conservation  Program 

The  ICP  is  a  federally  funded  program  that  provides  50 
percent  matching  grants  for  energy  conservation  activities.   In 
Montana,  the  ICP  is  administered  by  DNRC. 

The  ICP  provides  funding  for  detailed  engineering  and  ■  ' 
architectural  analyses  (Technical  Assistance  Report,  or  TA) 
which  identify  potential  energy-saving  modifications  for  public 
and  non-profit  private  schools,  hospitals,  local  government 
buildings,  and  public  care  institutions.   The  ICP  also  provides 
matching  grants  to  eligible  schools  and  hospitals  for 
implementing  the  ECMs  identified  in  TA  reports. 

Energy  Conservation  Measures 

The  ECMs  considered  in  this  analysis  were  performed  between 
1981  and  1985.   All  of  the  ECMs  were  implemented  to  reduce  space 
and  water  heating  natural  gas  consumption,  with  the  majority 
targeting  space  heating  reductions.   ECMs  range  from  inexpensive 
measures  such  as  putting  time  clocks  on  water  heaters  at  a  cost 
of  $300,  to  measures  with  a  high  first  cost,  such  as  window 
replacements  at  $113,000.   Most  schools  had  more  than  one  ECM 
implemented,  and  a  list  of  the  ECMs  for  each  school  can  be  found 
on  table  A  in  the  appendix. 

ECMs  can  bo  divided  into  two  major  categories.   Some  ECMs, 
such  as  boiler  controls,  are  only  effective  if  maintenance 
personnel  are  properly  trained  and  operate  the  systems  at 
maximum  efficiency.   Other  ECMs,  such  as  increasing  the  levels  of 
insulation  in  ceilings,  are  passive  and  do  not  require  operator 
intervention.   It  is  not  feasible  to  separate  the  effects 
resulting  from  passive  ECMs  from  the  effects  of  operation  and 
maintenance  ECMs  in  this  analysis,  so  the  measures  performed  at 
each  school  will  be  analyzed  as  a  package. 

DNRC  started  with  a  sample  of  about  6  0  gas-heated  schools 
that  were  potential  candidates  for  analysis.   After  excluding 
schools  with  less  than  two  years  of  pre-ECM  consumption  data  and 
schools  that  had  undergone  major  changes  in  the  floor  area  served 
by  the  heating  system,  a  total  of  24  schools  remained. 


Evaluation  Objectives 

This  evaluation  was  performed  to  assess  the  actual  costs  and 
energy  savings  that  result  from  ECMs  implemented  in  Montana 
schools,  and  to  determine  if  there  is  a  significant  difference 
between  these  costs  and  savings  and  the  estimated  costs  and 
savings  identified  in  technical  assistance  reports. 

Also,  a  defensible  analysis  of  monitored  energy  use 
differences  provides  information  for  determining  the  cost 
effectiveness  of  energy  conservation  programs. 


Data  Sources 

Energy  Consumption  Data.     Monthly  energy  use  data  were 
obtained  from  billing  records  submitted  by  school  administrators 
and  from  Montana  Power  Company.   Billing  records  contain  the  date 
the  meters  were  read,  and  the  amount  of  natural  gas  (mcf)  and 
electricity  (kWh)  used  since  the  previous  meter  reading. 

Cost  Data.     Estimated  ECM  costs  were  submitted  to  DNRC  as  a 
part  of  ICP  grant  applications.   The  estimated  costs  were 
developed  by  architectural  and  engineering  firms  that  performed 
detailed  energy  audits,  or  TA  on  the  schools.   For  most  schools, 
more  than  one  ECM  was  recommended  in  the  TA,  and  individual  ECM 
costs  were  documented.   The  actual  costs  of  each  ECM  performed  at 
the  schools  were  submitted  to  DNRC  after  the  work  was  performed. 

Degree  Day  Data.     Degree  days  are  a  measure  of  the  relative 
warmth  of  a  given  day.   Degree  days  are  calculated  by  subtracting 
the  average  outside  temperature  (the  sum  of  the  highest 
temperature  plus  the  lowest  temperature,  divided  by  2)  from  the 
average  inside  temperature  for  a  given  day.   For  this  analysis, 
65  F  was  used  for  average  inside  temperature. 

DNRC  developed  a  computer  program  to  calculate  the  sum  of 
base  65  degree  days  for  each  billing  period  for  each  school  from 
daily  maximum  and  minimum  temperatures  for  10  sites  in  Montana, 
Temperature  data  were  obtained  from  National  Oceanic  and 
Atmospheric  Administration  (NOAA)  publications.   Data  for  the 
site  nearest  each  school  were  used  to  generate  degree  days  per 
billing  period. 


DATA  ANALYSIS 

Cost  of  Energy  Conservation  Measures 

The  total  actual  cost  of  the  package  of  ECMs  performed  at 
each  school  ranged  from  a  low  of  $4,900  to  a  high  of  $160,100. 
The  mean  total  actual  cost  of  the  ECMs  for  the  25  schools  was 
$37,100.   Total  actual  costs  include  design  costs,  and  the  labor 
and  materials  used  to  implement  the  ECMs.   When  the  actual  costs 
of  the  ECMs  are  normalized  by  the  floor  area  of  the  schools,  the 
minimum  is  $0.1l/ft2,  the  maximum  is  $2.83/ft2,  and  the  mean  is 
$0.82/ft2. 

Table  1  lists  the  descriptive  statistics  for  the  total 
actual  costs  of  the  ECMs,  and  the  area  normalized  actual  ECM 
costs. 


Table  1.  Total  and  Area  Normalized  Actual  ECM  Costs 
Total  Actual  Cost 

($) 


Mean 
Minimum 
Maximum 
Std.  Dev. 


Cost  per  Square  Foot  of 
Floor  Area 
($/ft2) 


37,100 

4,900 

160,100 

35,300 


0.83 
0.11 
2.83 
0.62 


Comparison  of  Estimated  and  Actual  ECM  Costs 

The  estimated  cost  of  ECMs  proposed  for  each  school  were 
submitted  to  DNRC  as  a  part  of  the  initial  application  for  ECM 
grant  funding.   The  mean  estimated  cost  for  the  ECMs  was  $31,300, 
or  $0.70/ft2.   The  maximum  estimated  cost  was  $117,900,  or 
$1.93/ft2,  and  the  minimum  estimated  ECM  cost  was  $5,300,  or 
$0.12/ft2. 

In  general,  the  estimated  costs  of  the  ECMs  were  similar  to 
the  actual  ECM  costs.   There  is  no  statistically  significant 
difference  between  estimated  and  actual  costs  at  the  95  percent 
confidence  level. 


Figure  1  is  a  scatter  plot  of  the  estimated  and  actual  ECM 
costs  per  square  foot  of  floor  area.   The  solid  line  running 
through  the  graph  represents  the  points  where  actual  and 
estimated  costs  are  equal.   The  plot  indicates  that  the  total 
actual  ECM  costs  were  similar  to  the  estimated  ECM  costs  for  most 
schools. 
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Figure  1,  Estimated  and  Actual  ECM  Costs 


Analysis  of  Annual  Natural  Gas  Consumption 


Many  variables  influence  the  amount  of  space  heating  energy 
used  in  a  school.   These  include  the  rate  of  heat  loss  through 
the  building  shell,  the  rate  of  internal  heat  gains  from 
occupants  and  powered  equipment,  the  amount  and  orientation  of 
glass,  the  outside  temperature,  the  inside  temperature,  and  the 
efficiency  of  the  heating  system. 


One  variable  that  exerts  a  major  and  predictable  influence 
over  space  heating  use  is  outside  air  temperature.   Since  there 
are  large  variations  in  average  monthly  outside  air  temperature, 
some  method  of  normalizing  gas  consumption  to  account  for 
temperatures  differences  is  required  so  that  a  fair  comparison 
can  be  made  between  gas  consumption  during  different  periods. 

A  least-squares  linear  regression  technique  was  used  to 
determine  the  heating  response  of  the  schools  to  the  accumulated 
base  65  degree  days  per  billing  period.   Separate  regressions 
were  performed  on  pre-  and  post-ECM  monthly  gas  consumption  and 
degree  day  data.   The  year  in  which  ECMs  were  performed  was 
excluded  from  analysis  to  remove  any  uncertainty  about  which 
months  should  be  included  in  pre-  and  post-ECM  periods. 

Regression  coefficients  indicate  how  much  gas  will  be  used 
per  month  for  base  loads  such  as  water  heating,  and  provide  a 
measure  of  how  much  additional  gas  will  be  required  for  space 
heating  in  response  to  accumulated  degree  days.   Regression 
analysis  is  a  useful  tool  for  evaluating  energy  use  differences, 
but  this  technique  should  not  be  viewed  as  a  method  that  can 
exactly  capture  all  variables  that  influence  space  heating 
consumption.   Nonetheless,  using  regression  coefficients  to 
normalize  consumption  data  provides  a  more  accurate  comparison 
than  would  a  simple  comparison  of  annual  total  gas  use  for  pre- 
and  post-ECM  periods. 

Figure  2  shows  an  example  of  the  linear  function  generated 
by  least-squares  regression  analysis  of  post-ECM  consumption  data 
for  one  of  the  schools.   The  offset  of  the  line  indicates  the 
point  at  which  the  heating  system  of  the  building  will  begin  to 
call  for  heat,  and  the  slope  of  the  line  indicates  the  rate  at 
which  the  heating  system  will  consume  gas  at  various  degree  days 
per  period.   To  determine  how  much  gas  a  school  will  require  in  a 
given  month,  the  slope  is  multiplied  by  the  number  of  degree  days 
in  the  month  and  added  to  the  offset. 
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Figure  2,  Least-Squares  Regression  of  Post-ECM  Gas 

Consumption  on  Degree  Days  For  One  of  the  Schools 


Changes  in  Annual  Gas  Use  Resulting  From  ECMs 

To  determine  the  changes  in  natural  gas  consumption 
resulting  from  the  ECMs,  regression  coefficients  from  analysis 
of  pre-  and  post-ECM  data  sets  for  each  school  were  applied  to 
30-year  average  monthly  degree  day  data  for  Helena,  Montana. 
Helena  data  was  used  because  it  is  reasonably  representative  of 
the  average  weather  around  the  state. 
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For  each  school,  gas  consumption  was  calculated  for  the 
months  of  the  typical  year  and  than  summed  to  obtain  the  typical 
annual  consumption.   The  annual  consumption  from  pre-ECM 
regression  coefficients  was  compared  to  the  annual  consumption 
from  post-ECM  coefficients  to  determined  the  annual  difference. 

All  but  one  school  showed  a  decrease  in  natural  gas 
consumption  after  ECMs  were  performed.   The  mean  gas  consumption 
for  the  schools  as  a  group  prior  to  the  ECMs  was  5,540  mcf  per 
year.   The  mean  consumption  after  the  ECMs  was  4,310  mcf  per 
year,  which  is  a  decrease  of  1,230  mcf,  or  28  percent. 

One  school  showed  an  increase  in  natural  gas  use  after  the 
ECMs  were  implemented.   The  ECMs  at  this  school  were  performed  on 
the  gymnasium.   After  the  ECMs  were  implemented,  a  new  after- 
school  PE  program  was  started  for  girls '  fall  and  winter  indoor 
sports.   The  additional  hours  of  use  for  the  gymnasium  resulted 
in  greater  energy  use  for  the  building. 

The  mean  floor  area  of  the  schools  is  47,900  f t^ .   when  the 
savings  are  normalized  by  the  area  of  the  schools,  an  average  of 
24  cubic  feet  of  natural  gas  per  square  foot  of  floor  area  per 
year  was  saved  as  a  result  of  the  ECMs.   Results  for  individual 
schools  can  be  found  in  Appendix  B. 

Table  2  lists  the  descriptive  statistics  for  the  aggregate 
sample  of  schools.   The  statistics  show  that  there  is  a  large 
variation  in  the  size  of  the  schools  and  a  large  variation  in  the 
amount  of  gas  saved  at  each  school  as  a  result  of  the  ECMs. 


Table  2 
Floor  Area  and  Annual  Natural  Gas  Use 


Floor  Area 
(ft2) 

Pre-ECM 
(mcf) 

Use 

Post-ECM  Use 
(mcf) 

Mean 

47,900 

5,540 

4,310 

Minimum 

15,600 

2,010 

1,500 

Maximum 

129,700 

17,360 

12,280 

Std.  Dev. 

28,600 

4,370 

3,200 

ECMs  are  clearly  effective  in  reducing  space  heating  requirements 
for  most  schools .   The  data  shows  that  most  schools  realize  an 
immediate  reduction  in  gas  consumption  following  the 
implementation  of  ECMs.   The  data  also  shows  that  reduced  space 


heating  consumption  remains  consistent  over  time.   This  means 
that  the  schools  continue  to  have  smaller  heating  bills,  and  the 
effectiveness  of  the  ECMs  does  not  appear  to  degrade  over  time. 

Figure  3  is  a  distribution  histogram  of  natural  gas 
savings.   The  histogram  indicates  that  most  of  the  schools  used 
between  10  and  30  percent  less  gas  after  the  ECMs  were 
implemented.  ■ 
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Figure  3,  Distribution  of  Percent  Savings  for  Natural  Gas 
Positive  Percentages  Indicate  Decrease  in  Gas 
Consumption 

Estimated  Natural  Gas  Savings  From  Grant  Applications  Compared  to 
Actual  Savings 

In  general,  the  natural  gas  savings  estimates  in  the  ICP 
grant  applications  are  slightly  greater  than  the  actual  energy 
savings,  but  the  differences  between  mean  estimated  and  mean 
actual  savings  are  not  statistically  significant.  The  mean 
estimated  natural  gas  savings  was  1,600  mcf  per  year  for  the  24 
schools.   The  mean  actual  savings  as  determined  from  regression 
analysis  is  1,240  mcf  per  year.  Table  3  lists  the  descriptive 
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statistics  for  both  estimated  and  actual  natural  gas  savings. 
The  school  that  had  an  increase  in  post-ECM  gas  use  appears  in 
the  table  as  a  parenthetical  minimum,  indicating  an  increase  in 
gas  use  of  1,830  mcf. 


Table  3 
Estimated  and  Actual  Natural  Gas  Savings 


Mean 
Minimum 
Maximum 
Std.  Dev. 


Estimated  Savings 
(mcf /year) 

1,600 

210 

7,230 

1,580 


Realized  Savings 
(mcf /year) 

1,240 

(1,830) 

5,080 

1,470 


Figure  4  shows  a  scatter  plot  of  estimated  and  actual 
natural  gas  savings  for  the  25  schools.   The  plot  indicates  there 
is  reasonably  good  correlation  between  the  estimates  and  the 
actual  savings,  and  that  estimated  savings  are  generally  higher 
than  actual  savings.   The  line  running  through  the  graph 
represents  the  points  where  estimated  and  actual  savings  are 
equal. 


>N 


''1 


2  ♦ 

(Tbouioid*) 
Actuol  D«cr«o>«.  mcf/y«or 


Figure  4,  Estimated  and  Actual  Natural  Gas  Savings 
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ECONOMICS  OF  THE  ECMs 

Simple  Payback.      To  calculate  the  payback  for  the  package  of 
ECMs  implemented  at  each  school,  the  total  cost  of  the  ECMs  was 
divided  by  the  annual  savings  resulting  from  the  ECMs  multiplied 
by  the  price  of  natural  gas.   This  requires  an  assumption  about 
the  price  of  natural  gas.   For  our  purposes,  $4.50/mcf  is  a 
realistic  price,  considering  current  and  historic  natural  gas 
costs . 

Based  on  the  total  ECM  costs  and  the  savings  obtained  from 
regression  analysis,  the  mean  simple  payback  for  the  24  schools 
is  8.5  years.   The  minimum,  or  shortest  payback  is  0.6  years,  and 
the  longest  payback,  excluding  the  school  that  showed  an  increase 
in  gas  consumption,  is  28.0  years. 

Estimated  simple  payback  from  TA  reports  ranged  from  a 
minimum  payback  of  0.8  years  to  a  longest  payback  of  14.3  years. 
The  mean  payback  from  TA  reports  is  5  years. 

Net  Present  Value  of  the  ECMs.    A  better  approach  to  assessing 
the  economics  of  the  ECMs  is  to  use  a  net  present  value  (NPV) 
calculation.   NPV  comparisons  are  conunonly  used  to  evaluate 
investment  options,  and  are  appropriate  for  analyzing  the 
economic  benefits  that  result  from  investments  in  conservation. 
NPV  takes  into  account  the  cost  of  the  ECMs  and  the  real  value  of 
the  future  savings  that  will  result  from  the  ECMs.   For  instance, 
if  a  school  does  not  have  any  ECMs  performed  there  is  no  initial 
cost  for  conservation  and  no  savings  are  realized  over  time.   If 
ECMs  are  implemented,  an  initial  cost  is  incurred  for 
conservation,  and  heating  costs  would  be  reduced  in  the  future. 
The  NPV  of  the  ECMs  can  be  viewed  as  the  difference  between  the 
life-cycle  costs  that  result  from  heating  the  building  without 
ECMs  and  the  life-cycle  costs  of  the  ECMs  and  the  saving  that 
result  from  the  ECMs.   When  the  NPV  of  conservation  is  positive, 
an  economic  benefit  from  conservation  is  realized. 

The  NPV  calculations  used  for  this  evaluation  convert  future 
annual  energy  savings  over  a  fixed  lifetime  of  20  years  for  the 
ECM  into  real  dollars  using  a  4.3  percent  discount  rate.   This 
takes  into  account  interest  rates  and  inflation.   Although  the 
ECMs  were  performed  over  a  several-year  period,  from  1980  to 
1985,  initial  ECM  costs  were  not  adjusted  to  reflect  differences 
in  the  real  value  of  the  dollar.   The  price  of  natural  gas  was 
assumed  to  be  $4.50  per  mcf.  The  cost  of  natural  gas  is  expected 
to  remain  constant  in  real  terms  over  the  20  year  analysis 
period. 

The  mean  NPV  of  the  ECMs  performed  at  the  schools  is 
$34,600.   The  largest  positive  NPV  is  $243,700,  and  the  largest 
negative  NPV  is  -$32,200. 
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Seven  of  the  24  schools  had  a  negative  net  present  value. • 
This  means  that  these  schools  did  not  realize  large  enough 
natural  gas  savings  to  pay  for  the  ECMs .   The  remaining  17 
schools  realized  a  financial  benefit  from  the  conservation 
measures.   The  aggregate  data  for  the  24  schools  as  a  group 
shows  that  the  savings  outweighed  the  costs  for  the  ECMs  and  the 
group  realized  a  combined  economic  benefit  of  $829,700. 

When  the  estimated  costs  and  gas  savings  from  TA  reports  are 
used  to  calculate  an  estimated  NPV,  eight  of  the  schools  show  a 
negative  estimated  NPV.   All  seven  of  the  schools  that  have  a 
negative  NPV  from  actual  costs  and  savings  show  a  negative  NPV 
from  estimated  costs  and  savings.   This  finding  demonstrates  that 
NPV  calculations  would  be  better  than  simple  payback  as  an 
economic  criteria  for  selecting  conservation  measures  for 
funding. 

CONCLUSIONS  AND  RECOMMENDATIONS 

The  majority  of  the  schools,  23  out  of  24,  used  less  natural 
gas  after  the  ECMs  than  was  used  prior  to  the  ECMs.   However, 
seven  of  the  schools  did  not  realize  a  large  enough  reduction  in 
gas  use  to  justify  the  investment  in  conservation.   As  a  group, 
the  24  schools  realized  an  economic  benefit  from  the  ECMs. 

The  mean  total  cost  of  the  ECMs  was  $37,100  and  the  mean 
annual  decrease  in  natural  gas  use  is  1,240  mcf.   Using  a  20- 
year  lifetime,  4.6  percent  real  discount  rate,  and  $4.50/mcf,  the 
mean  net  present  value  of  the  ECMs  is  $34,570  per  schopl. 

Estimated  ECM  costs  and  natural  gas  savings  are  generally 
similar  to  the  actual  costs  and  saving.  The  differences  between 
estimated  and  actual  costs  and  savings  are  not  statistically 
significant. 

Since  ECMs  have  been  found  to  be  generally  cost-effective, 
schools  that  are  candidates  for  future  ECMs  would  probably 
benefit  from  similar  conservation  efforts.   However,  a  better 
method  of  determining  which  ECMs  are  appropriate  candidates  for 
funding  should  be  developed.   DNRC  has  shown  that  NPV 
calculations  provide  a  more  accurate  economic  evaluation  of 
conservation  investments. 

The  benefits  accruing  to  the  schools  that  implemented  ECMs 
result  in  lower  heating  costs.   This  directly  reduces  the 
operating  expenses  of  the  schools  and  provides  a  benefit  to  all 
taxpayers.   Additionally,  the  measures  installed  in  Montana 
schools  clearly  result  in  savings  that  exceed  the  initial  cost  of 
installing  the  ECMs.   Therefore,  DNRC  recommends  that  DOE 
continue  to  fund  the  ICP  program. 
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